Automated store system and server

ABSTRACT

A store management server configured to communicate with an alert device installed in a store, includes a network interface and a processor configured to identify a customer entering the store, acquire customer information about the identified customer, detect that the customer is holding a commodity in the store, acquire sales restriction information about the commodity held by the customer, determine whether the customer is eligible to buy the commodity held by the customer based on the acquired customer information and sales restriction information, and control the network interface to transmit, when it is not determined that the customer is eligible to buy the commodity, a first command to an alert device. The first command causes the alert device to output an alert.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.16/575,189, filed Sep. 18, 2019, which is based upon and claims thebenefit of priority from Japanese Patent Application No. 2018-190716,filed Oct. 9, 2018, the entire contents of which are incorporated hereinby reference.

FIELD

Embodiments described herein relate generally to an automated storesystem and a server.

BACKGROUND

In recent years, an automated store where a customer can buy commoditieswithout checkout by a cashier has been tested. Such an automated storesystem identifies customers entering and exiting a store and performs,with a preset checkout method, checkout for the commodities taken outfrom the store by the customers. However, in the existing automatedstore system, it is difficult to sell age-limited commodities withoutconfirmation by a store clerk.

DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram of an automated store system according toan embodiment;

FIG. 2 is a block diagram of the automated store system;

FIG. 3 is a block diagram of a server in the automated store system;

FIG. 4 is a block diagram illustrating a store-entry control device inthe automated store system;

FIG. 5 is a block diagram illustrating a store-leaving control device inthe automated store system;

FIG. 6 is a diagram illustrating a commodity database in the automatedstore system;

FIG. 7 is a diagram illustrating a customer database in the automatedstore system;

FIG. 8 is a flowchart of a first operation performed by the server inthe automated store system;

FIG. 9 is a diagram illustrating a virtual basket generated by theserver in the automated store system;

FIG. 10 is a diagram illustrating an actual example of the virtualbasket storing information about commodities to be purchased by acustomer

FIG. 11 is a flowchart of a second operation performed by the server inthe automated store system; and

FIG. 12 is a flowchart of the second operation performed by the serverin the automated store system.

DETAILED DESCRIPTION

Embodiments provide an automated store system and a server that cansell, without attendance by a store clerk, sales-restricted commoditiespermitted to be sold to only a customer having a specific authority.

According to an embodiment, a store management server configured tocommunicate with an alert device installed in a store, includes anetwork interface and a processor configured to identify a customerentering the store, acquire customer information about the identifiedcustomer, detect that the customer is holding a commodity in the store,acquire sales restriction information about the commodity held by thecustomer, determine whether the customer is eligible to buy thecommodity held by the customer based on the acquired customerinformation and sales restriction information, and control the networkinterface to transmit, when it is not determined that the customer iseligible to buy the commodity, a first command to an alert device. Thefirst command causes the alert device to output an alert.

An embodiment is explained below with reference to the drawings.

FIG. 1 is a schematic diagram of an automated store system according toan embodiment.

As illustrated in FIG. 1 , the automated store system according to thisembodiment is installed in a store where a store entrance and a storeexit are provided. In the store where the automated store system isinstalled, a customer enters the store from the store entrance andthereafter takes commodities that the customer desires to purchase inthe store, and leaves the store from the store exit. The automated storesystem executes processing such as store entry processing, monitoringprocessing, and store leaving processing on customers who visit thestore. According to these kinds of processing, the automated storesystem makes it possible to sell restricted commodities in the store tothe customers even if a store clerk is absent in the store.

The store entry processing is processing for identifying, based oncustomer information registered in advance, a customer who enters thestore. The automated store system permits store entry (i.e., passagethrough the store entrance) of a customer whose customer information isregistered.

The monitoring processing is processing for monitoring behavior in thestore by the customer who has entered the store. In the monitoringprocessing, the automated store system detects behavior of the customerwith, for example, images photographed by a camera from inside thestore. In the monitoring processing, for example, the automated storesystem specifies a commodity taken by the customer in the store.

The store leaving processing is processing for determining commoditiespurchased by a customer who is about to leave the store (i.e.,commodities taken out from the store by the customer). In the storeleaving processing, if all commodities held by the customer who is aboutto leave the store are commodities that can be sold to the customer, theautomated store system determines the commodities as commodities to bepurchased by the customer. In the store leaving processing, theautomated store system permits the customer having the determinedcommodities to leave the store (i.e., passage through the exit).Further, the automated store system executes checkout processing for thecommodities determined to be purchased by the customer.

Further, the automated store system according to the present embodimentchecks whether a commodity held by the customer or a commodity that hasbeen touched by the customer in the store is a commodity that can besold to the customer. In the present embodiment, the store sellscommodities that can be sold without any restriction and commoditiesthat can be sold to only customers satisfying a sales condition such asage or qualification (i.e., customers having a specific authority)(hereinafter sales-restricted commodities). Examples of thesales-restricted commodities include commodities sales-restricted by agesuch as liquors or tobaccos (i.e., age-limited commodities). Theage-limited commodities are commodities that can be sold to onlycustomers in age set as a sales condition and are prohibited to be soldto customers not in the age set as the sales condition. Thesales-restricted commodities may be, for example, commodities that canbe sold to only customers having preset qualification or authority.

For example, if a customer appears in the store exit holding asales-restricted commodity not satisfying the sales condition (i.e., acommodity not permitted to be sold to the customer), the automated storesystem prohibits the customer from leaving the store or outputs analert. If a customer touches a sales-restricted commodity not satisfyingthe sales condition (i.e., a commodity not permitted to be sold to thecustomer), the automated store system may emit an alert.

The configuration of the automated store system according to oneembodiment is explained.

In the configuration example illustrated in FIG. 2 , the automated storesystem 10 includes a server 11, a store-entry control device 12, asensor 12 a, a gate 12 b, an information acquiring device 13, one ormore cameras 14, a store-leaving control device 15, a sensor 15 a, agate 15 b, an alert device 16 (e.g., an alarm), a commodity database 17,and a customer database 18. The sensor 12 a and the gate 12 b areconnected to the store-entry control device 12. The sensor 15 a and thegate 15 b are connected to the store-leaving control device 15.

The server 11 controls the entire automated store system 10. The server11 is connected to the store-entry control device 12, the informationacquiring device 13, the cameras 14, the store-leaving control device15, and the alert device 16 via a network. The server 11 executesprocessing for acquiring information from the devices and sellingcommodities disposed in the store to customers. The server 11 isconnected to a storage device that stores the commodity database 17 andthe customer database 18. The server 11 accesses the commodity database17, the customer database 18, and the like and executes various kinds ofprocessing as appropriate.

The store-entry control device 12 detects a customer at the storeentrance and restricts the customer from entering the store. The sensor12 a detects the customer present near the store entrance. For example,the sensor 12 a detects the customer approaching the store entrance. Thegate 12 b provided at the store entrance restricts the customer fromentering the store. For example, the store-entry control device 12 opensand closes the gate 12 b according to an instruction from the server 11to thereby restrict the customer detected by the sensor 12 a fromentering the store.

The information acquiring device 13 acquires information includingcustomer identification information for the customer who is about toenter the store. The information acquiring device 13 transmits theacquired information including the customer identification informationto the server 11. The information acquiring device 13 may be connectedto the store-entry control device 12 and configured to transmit theinformation to the server 11 via the store-entry control device 12. Inthis case, the information acquiring device 13 is capable of acquiringthe information according to control by the store-entry control device12 that can detect the customer present at the store entrance.

The information acquiring device 13 may read the customer identificationinformation from a recording medium (e.g., an IC card, a magnetic card,etc.) presented by the customer or may acquire biological information(e.g., a fingerprint, a face, an iris, etc.) of the customer as thecustomer identification information. For example, if the informationacquiring device 13 is configured to read the customer identificationinformation from the IC card presented by the customer, the informationacquiring device 13 controls a card reader to read information from theIC card. The information acquiring device 13 may acquire the customeridentification information from a code displayed or printed on arecording medium presented by the customer (e.g., a two-dimensional codedisplayed on a portable terminal or a two-dimensional code printed on asheet). In this case, the information acquiring device 13 controls acode scanner to read a code displayed on the recording medium presentedby the customer. If the biological information of the person is acquiredas the customer identification information, the information acquiringdevice 13 controls a scanning device to acquire the biologicalinformation from the customer.

In the following explanation, it is assumed that the informationacquiring device 13 is a card reader. The information acquiring device13 reads information including customer identification information froma card presented by the customer at the store entrance. The card read bythe information acquiring device 13 may be a contactless IC card, acontact IC card, or a magnetic card including a magnetic storingsection.

The cameras 14 photograph the inside of the store. The cameras 14photograph people present in the store and commodities disposed in thestore. Any number of cameras 14 may be set to cover the entire floor ofthe store. The cameras 14 may move according to the movements ofcustomers in the store.

The store-leaving control device 15 detects the customer leaving fromthe store at the store exit or gateway. The store-leaving control device15 is connected to the server 11, the sensor 15 a, and the gate 15 b.The gate 15 b is installed at the store exit. The store-leaving controldevice 15 opens and closes the gate 15 b according to an instructionfrom the server 11 to restrict the customer from leaving the store. Forexample, if receiving an instruction to prohibit a customer from leavingthe store from the server 11, the store-leaving control device 15 closesthe gate 15 b and restricts the customer from leaving the store.

The alert device 16 outputs an alert to a customer. The alert device 16is, for example, a display, a speaker, or the like. The alert device 16outputs an alert according to an instruction from the server 11. Forexample, if receiving, from the server 11, an instruction to prohibit acustomer present at the store exit from leaving the store, the alertdevice 16 outputs an alert so that the customer does not leave thestore. The display functioning as the alert device 16 displays a messageor the like indicating a warning corresponding to the instruction fromthe server 11. The speaker functioning as the alert device 16 outputs,by sound, a warning or alarm corresponding to the instruction from theserver 11.

The alert device 16 may output an alert only to the customer. Forexample, in an automated store system according to a first operationexplained below, the alert device 16 is configured to output the alertto the customer at the store exit. In the first operation explainedbelow, the alert device 16 is provided near the store exit. The alertdevice 16 may be set on a plurality of places such as a ceiling and awall in the store. For example, in an automated store system accordingto a second operation explained below, the alert device 16 is configuredto output the alert to the customer present in a position where asales-restricted commodity is displayed. In the second operationexplained below, a plurality of alert devices 16 is set in a pluralityof places in the store. If the plurality of alert devices 16 is set inthe plurality of places, the server 11 choose one of the alert devices16 installed at a certain location and control the alert device 16 tooutput the alert.

The configuration of a control system in the server 11 is explained.

FIG. 3 is a block diagram of the control system in the server 11according to this embodiment.

In the configuration example illustrated in FIG. 3 , the server 11includes a processor 31, a RAM (random-access memory) 32, a ROM(read-only memory) 33, a data memory 34 (e.g., a storage device),various interfaces (I/Fs) 35 and 36, and a network interface (NW I/F)37.

The processor 31 executes various kinds of processing by executingcomputer programs. The processor 31 is, for example, a CPU (centralprocessing unit). The processor 31 performs various processing functionsby executing computer programs stored in the ROM 33 or the data memory34. For example, by executing a computer program for store entryprocessing, the processor 31 executes store entry processing forrestricting a customer from entering the store, via the store-entrycontrol device 12. By executing a computer program for monitoringprocessing, the processor 31 executes monitoring processing formonitoring behavior of the customer in the store. By executing acomputer program for store leaving processing, the processor 31 executesstore leaving processing for restricting the customer from leaving thestore, via the store-leaving control device 15.

The RAM 32 operates as a working memory. The RAM 32 stores, asappropriate, data referred to by the processor 31 in executing thevarious kinds of processing, data temporarily used by the processor 31,or the like.

The ROM 33 is a nonvolatile memory and stores computer programs anddata. For example, the ROM 33 stores computer programs such as anoperating system, middleware, and applications. The ROM 33 may storedata referred to by the processor 31 in executing the various kinds ofprocessing.

The data memory 34 is a storage device that stores data. The data memory34 is a rewritable nonvolatile memory. The data memory 34 is, forexample, an HDD (hard disk drive) or an SSD (solid state drive). Thedata memory 34 stores data used by the processor 31 in executing thevarious kinds of processing or data generated in the processing by theprocessor 31. The data memory 34 may store various computer programs tobe executed by the processor 31.

The interface 35 is an interface for accessing the commodity database17. For example, the interface 35 is an interface for communicating witha storage device or a data server that stores the commodity database 17.The commodity database 17 may be stored in the data memory 34.

The interface 36 is an interface for accessing the customer database 18.For example, the interface 36 is an interface for accessing a dataserver that stores the customer database 18. The customer database 18may be stored in the data memory 34.

The NW I/F 37 is an interface for communicating with the store-entrycontrol device 12, the information acquiring device 13, the camera 14,the store-leaving control device 15, and the alert device 16 via anetwork. For example, the server 11 acquires, via the NW I/F 37, animage photographed by the camera 14. The server 11 acquires, via the NWI/F 37, information including customer identification informationacquired by the information acquiring device 13. The server 11 outputs,via the NW I/F 37, a control signal for instructing opening and closingof the gate 12 b to the store-entry control device 12. The server 11outputs a control signal for instructing opening and closing of the gate15 b to the store-leaving control device 15 via the NW I/F 37.

The configuration of a control system in the store-entry control device12 is explained.

FIG. 4 is a block diagram illustrating the control system in thestore-entry control device 12 according to this embodiment.

In the configuration example illustrated in FIG. 4 , the store-entrycontrol device 12 includes a processor 41, a RAM 42, a ROM 43, a datamemory 44, a NW I/F 45, and interfaces (I/Fs) 45 and 46.

The processor 41 executes various kinds of processing by executingcomputer programs. The processor 41 is, for example, a CPU. Theprocessor 41 performs various processing functions by executing computerprograms stored in the ROM 43 or the data memory 44. The processor 41 ofthe store-entry control device 12 may execute store entry processingexplained below in cooperation with the server 11.

The RAM 42 operates as a working memory. The RAM 42 stores, asappropriate, data referred to by the processor 41 in executing thevarious kinds of processing, data temporarily used by the processor 41,or the like.

The ROM 43 is a nonvolatile memory and stores computer programs anddata. For example, the ROM 43 stores computer programs such as anoperating system, middleware, and applications. The ROM 43 may storedata referred to by the processor 41 in executing the various kinds ofprocessing.

The data memory 44 is a storage device that stores data. The data memory44 is a rewritable nonvolatile memory. The data memory 44 is, forexample, an HDD or an SSD.

The NW I/F 45 is an interface for communicating with the server 11 via anetwork. For example, the NW I/F 45 acquires a signal for instructingopening and closing of the gate 12 b from the server 11.

The interface 46 is an interface for communicating with the sensor 12 a.For example, the interface 46 receives information indicating adetection result of a customer from the sensor 12 a.

The interface 47 is an interface for communicating with the gate 12 b.For example, the interface 47 supplies a signal for controlling openingand closing of the gate 12 b to the gate 12 b.

The configuration of a control system in the store-leaving controldevice 15 is explained.

FIG. 5 is a block diagram illustrating the control system in thestore-leaving control device 15 according to this embodiment.

In the configuration example illustrated in FIG. 5 , the store-leavingcontrol device 15 includes a processor 51, a RAM 52, a ROM 53, a datamemory 54, a network interface (NW I/F) 55, and interfaces (I/Fs) 56 and57.

The processor 51 executes various kinds of processing by executingcomputer programs. The processor 51 is, for example, a CPU. Theprocessor 51 performs various processing functions by executing computerprograms stored in the ROM 53 or the data memory 54. The processor 51 ofthe store-leaving control device 15 may execute store-leaving processingexplained below in cooperation with the server 11.

The RAM 52 operates as a working memory. The RAM 52 stores, asappropriate, data referred to by the processor 51 in executing thevarious kinds of processing, data temporarily used by the processor 51,or the like.

The ROM 53 is a nonvolatile memory and stores computer programs anddata. For example, the ROM 53 stores computer programs such as anoperating system, middleware, and applications. The ROM 53 may storedata referred to by the processor 51 in executing the various kinds ofprocessing.

The data memory 54 is a storage device that stores data. The data memory54 is a rewritable nonvolatile memory. The data memory 54 is, forexample, an HDD or an SSD.

The network interface 55 is an interface for communicating with theserver 11 via a network. For example, the network interface 55 receivesa signal for instructing opening and closing of the gate 15 b from theserver 11.

The interface 56 is an interface for communicating with the sensor 15 a.For example, the interface 56 receives information indicating adetection result of a customer from the sensor 15 a.

The interface 57 is an interface for communicating with the gate 15 b.For example, the interface 57 supplies a signal for controlling openingand closing of the gate 15 b to the gate 15 b.

The customer database 18 in the automated store system is explained.

FIG. 6 is a diagram illustrating a configuration example of the customerdatabase 18.

The customer database 18 stores customer information indicating thesales condition in association with customer identification informationfor each of customers. The customer database 18 is stored in the storagedevice accessible from the server 11. In the configuration exampleillustrated in FIG. 2 , the customer database 18 is stored in theexternal device of the server 11 (e.g., the data server of the customermanagement system). The customer database 18 may be stored in thestorage device (the data memory 34, etc.) in the server 11.

In the configuration example illustrated in FIG. 6 , the customerdatabase 18 stores, for each of customers, records each associatingcustomer identification information (e.g., a customer ID) with a name,an age, and a payment method.

The customer identification information uniquely identifies thecustomers. In the example illustrated in FIG. 6 , the customeridentification information is a customer ID assigned to each of thecustomers. In this embodiment, the customer identification informationcorresponds to the information acquired by the information acquiringdevice 13. For example, if the information acquiring device 13 is a cardreader, the customer identification information is the information readfrom a card presented by the customer (i.e., information stored in thecard of the customer). If the information acquiring device 13 is adevice that reads biological information (e.g., a face image, afingerprint, or a voiceprint) of a customer, the customer identificationinformation is the biological information of the customer. If theinformation acquiring device 13 is an input device to which information(e.g., a password) is input by operation by a customer, the customeridentification information is the password input by the customer.

The name is information indicating the name of the customer. The age isinformation indicating the age of the customer. For example, the age isused for checking whether the customer is eligible to buy asales-restricted commodity. Any other information may be used forchecking whether the customer is eligible to buy the sales-restrictedcommodity. That is, the customer database 18 may store, for each of thecustomers, other information for confirming whether the sales conditionfor the sales-restricted commodity is satisfied. For example, if asales-restricted commodity is allowed to be sold to only customers whohold a specific qualification, the customer database 18 stores not onlythe age of the customer but also information indicating whether thecustomer holds such aa qualification.

The payment method is information indicating a method for checking outcommodities to be purchased by the customer. For example, as the paymentmethod, a checkout method such as a credit card or direct debit may beset. The automated store system according to this embodiment performs,after commodities to be purchased by the customer are determined (i.e.,after the customer leaves the store), checkout of the commodities.

The commodity database 17 in the automated store system 10 according tothe present embodiment is explained.

FIG. 7 is a diagram illustrating a configuration example of thecommodity database 17.

The commodity database 17 stores commodity information indicating salesconditions for commodities displayed in the store. The commoditydatabase 17 is stored in a storage device accessible from the server 11.In the configuration example illustrated in FIG. 2 , the commoditydatabase 17 is stored in an external device of the server 11 (e.g., adata server of a customer management system). The commodity database 17may be stored in a storage device (the data memory 34, etc.) of theserver 11.

In the configuration example illustrated in FIG. 7 , the commoditydatabase 17 stores, for each of commodities (or types of thecommodities), records each associating commodity identificationinformation with a commodity name and a sales condition.

The commodity identification information uniquely specifies a commodity.In the example illustrated in FIG. 7 , the commodity identificationinformation is a commodity code represented by a predetermined length ofnumbers or symbols. The sales condition indicates a condition forselling the commodity. Concerning a commodity without any salescondition (i.e., a commodity without any sales restriction), informationindicating that there is no condition for selling the commodity isstored. Concerning a commodity for which some sales condition is set(i.e., a sales-restricted commodity), information indicating a conditionfor selling the commodity is stored. For example, as the salescondition, the age required to buy the commodity is stored for such arestricted commodity.

The operations of the automated store system including first and secondoperations are explained.

In the first operation, if a customer leaves the store from the storeexit, the automated store system checks whether all commodities held bythe customer satisfy each sales condition. If the customer is about toleave the store, the wireless store system outputs an alert if thecustomer has a commodity not permitted to be sold to the customer.

FIG. 8 is a flowchart for explaining the first operation performed bythe server 11 in the automated store system.

At the store entrance, the store-entry control device 12 detects, withthe sensor 12 a, a customer appearing at the store entrance (orapproaching the store entrance). The information acquiring device 13acquires information concerning the customer who is about to enter thestore. The information acquiring device 13 transfers the acquiredinformation concerning the customer to the server 11. For example, theinformation acquiring device 13 acquires information indicating that thecustomer is a customer registered in the customer database 18 (i.e., thecustomer identification information).

For example, in operation for identifying the customer with a customerID recorded in a storage medium (e.g., an IC card) carried by thecustomer, the information acquiring device 13 reads the customer ID fromthe storage medium presented by the store visitor. In operation foridentifying the customer with biological information (e.g., a faceimage, a fingerprint, or a voice print), the information acquiringdevice 13 acquires the biological information from the customer. Inoperation for identifying the customer with information (e.g., apassword) input by the customer, the information acquiring device 13accepts and recognizes the information (i.e., the password) input by thecustomer.

The processor 31 of the server 11 receives, via the NW I/F 37, theinformation concerning the customer acquired from the customer by theinformation acquiring device 13 (ACT 11). If receiving the informationconcerning the customer, the processor 31 of the server 11 determines,based on the received information concerning the customer, whether thecustomer is registered in the customer database 18 (ACT 12). Forexample, the processor 31 acquire customer identification informationfrom the information concerning the customer acquired by the informationacquiring device 13, and searches the customer database 18 for theacquired customer identification information. If the customeridentification information acquired from the information concerning thecustomer is included in the customer database 18, the processor 3 lidentifies the customer as a registered customer.

If the customer is registered (YES in ACT 12), the processor 31 controlsthe gate 12 b to open the gate 12 b provided at the store entrance (ACT13). For example, the processor 31 supplies a control command foropening the gate 12 b to the store-entry control device 12 via the NWI/F 37. The store-entry control device 12 restricts the customerdetected by the sensor 12 a from entering the store while keeping thegate 12 b closed and opens the gate 12 b according to an openinginstruction from the server 11. Consequently, the processor 31 can allowthe registered customer to enter the store.

If the customer is registered (YES in ACT 12), the processor 31 createsa virtual basket for the customer that stores information concerning acommodity to be purchased by the customer (ACT 14). For example, theprocessor 31 allocates in the RAM 32 a storage region 32 a of thevirtual basket for the customer. Every time the processor 31 detectsthat the customer takes a commodity in the store, the processor 31stores the information indicating the commodity in the virtual basket(i.e., the storage region 32 a). If detecting that the customer returnsa commodity, the processor 31 deletes information indicating thereturned commodity from the virtual basket (i.e., the storage region 32a).

FIG. 9 is a diagram illustrating an example of a structure of thevirtual basket generated for each of customers present in the store.FIG. 10 shows an actual example of the virtual basket that storesinformation about commodities to be purchased by a customer.

If a customer enters the store, the processor 31 generates, in the RAM32, the virtual basket (i.e., the storage region 32 a) for the customerillustrated in FIG. 9 . If the customer holds a commodity displayed inthe store, as illustrated in FIG. 10 , the processor 31 storesinformation indicating the commodity in the virtual basket for thecustomer. If the customer returns the commodity once held by thecustomer in the store, the processor 31 deletes the informationindicating the commodity from the virtual basket for the customer.

In the examples illustrated in FIGS. 9 and 10 , the virtual basket isconfigured to store information indicating commodities to be purchasedin a list format. In the virtual basket illustrated in FIGS. 9 and 10 ,a customer ID is stored as customer identification information foridentifying a customer. The virtual basket stores information concerningcommodities held by the customer. As the information concerning thecommodities held by the customer, the virtual basket stores, concerningthe individual commodities, information indicating a commodity code, acommodity name, a quantity, and a sales condition (or restriction).

The commodity code is commodity identification information for uniquelyspecifying a commodity (or a type of the commodity). The commodity nameis a name given to the commodity. The quantity indicates the number ofthe commodities (or commodities of the same type) held by the customer.The sales condition is information indicating a condition of a customerto whom the commodity can be sold. For example, if the commodity is nota sales-restricted commodity (i.e., a commodity not restricted to besold), the sales condition is stored as “none”. If the commodity is asales-restricted commodity, the sales condition indicates a condition(e.g., age limit, etc.) to whom sales of the commodity is permitted.

The processor 31 performs monitoring processing for monitoring behaviorof the customer in the store (i.e., customer behavior recognitionprocessing). For example, the processor 31 detects with the monitoringprocessing that, as the behavior of the customer in the store, thecustomer takes a commodity, the customer returns a commodity, and thecustomer is about to leave the store. The processor 31 may execute themonitoring processing as a process separate from the other processing,such as the store entry processing and the store leaving processing.

In the monitoring processing, the processor 31 monitors, based on one ormore images or a video taken by the camera 14, whether the customertakes a commodity displayed in the store (ACT 15). For example, if theprocessor 31 detects from the video that the customer puts a commodityin his real basket in the store (e.g., a bag or a cart), the processor31 considers that the customer takes the commodity. Alternatively, ifthe processor 31 detects from the video that the customer picks up acommodity in the store and moves, the processor 31 may consider that thecustomer takes the commodity.

If detecting that the customer takes a commodity (YES in ACT 15), theprocessor 31 specifies the commodity taken by the customer. For example,the processor 31 specifies the commodity taken by the customer byrecognizing the commodity from the images taken by the camera 14. Theprocessor 31 may specify the commodity according to a display locationof the commodity taken by the customer. The processor 31 may specify thecommodity taken by the customer concurrently using a sensor or the likethat detects the commodity displayed at a predetermined location.

After specifying the commodity taken by the customer, the processor 31acquires information concerning the commodity taken by the customer fromthe commodity database 17. After acquiring information concerning thecommodity taken by the customer, the processor 31 stores the informationindicating the commodity taken by the customer in the virtual basket(i.e., the storage region 32 a) (ACT 16). In the first operation, theprocessor 31 stores, as the information indicating the commodity takenby the customer, information indicating a sales condition for thecommodity in the virtual basket as well. For example, as illustrated inFIG. 10 , the processor 31 stores in the virtual basket a salescondition for a sales-restricted commodity, and stores “none” for acommodity that is not a sales-restricted commodity.

In the monitoring processing, the processor 31 monitors, based on, forexample, one or more images or a video taken by the camera 14, whetherthe customer returns a commodity once taken by the customer in the store(ACT 17). For example, if the processor 31 detects, from the video, thecustomer's behavior or a motion to return a commodity to the originallocation, the processor 31 considers that the customer returns thecommodity. If the processor 31 confirms that the customer takes out acommodity from the customer's basket or bag and places the commodity atthe original location in the store, the processor 31 may consider thatthe customer returns the commodity.

If detecting that the customer returns the commodity (YES in ACT 17),the processor 31 executes commodity return processing for the commodityreturned by the customer (ACT 18). As the commodity return processing,the processor 31 specifies the commodity returned by the customer. Afterspecifying the commodity returned by the customer, as the commodityreturn processing, the processor 31 deletes information indicating thecommodity returned by the customer from the virtual basket for thecustomer. For example, the processor 31 specifies the commodity returnedby the customer by performing image recognition on the images or videotaken by the camera 14. The processor 31 may specify the commodityreturned by the customer based on display locations of commodities inthe store. The processor 31 may specify the commodity returned by thecustomer concurrently using a sensor that detects a commodity at apredetermined display location.

In the monitoring processing, the processor 31 monitors, based on, forexample, the images or video taken by the camera 14, whether thecustomer is about to leave the store (i.e., perform a store leavingaction) (ACT 19). For example, if the customer moves to the store exit,the processor 31 considers that the customer is about to leave thestore. If the sensor 15 a provided at the store exit detects thecustomer, the processor 31 may consider that the customer is about toleave the store.

If detecting that the customer is about to leave the store (YES in ACT19), the processor 31 checks commodities that the customer is about totake out from the store. First, the processor 31 determines whether thecustomer about to leave the store is holding one or moresales-restricted commodities (ACT 20). For example, the processor 31determines whether information indicating sales-restricted commoditiesis stored in the virtual basket (the storage region 32 a) for thecustomer. If the information indicating sales-restricted commodities isstored in the virtual basket for the customer, the processor 31determines that the customer is holding sales-restricted commodities.

If the customer is not holding any sales-restricted commodity (YES inACT 20), the processor 31 controls the gate 15 b to open the gate 15 bprovided at the store exit (ACT 21). For example, the processor 31supplies a control signal for opening the gate 15 b (i.e., an openingsignal) to the store-leaving control device 15. The store-leavingcontrol device 15 receives the control signal from the server 11 withthe NW I/F 55. The processor 51 of the store-leaving control device 15controls the gate 15 b to open according to the opening signal from theserver 11. Consequently, the customer is permitted to pass through thestore exit and leave the store. If the processor 31 permits the customerto leave the store, the processor 31 may inform, using the alert device16 connected via the NW I/F 37, guidance indicating that the customer ispermitted to leave the store.

After permitting the customer to leave the store (ACT 21), the processor31 executes checkout processing for commodities present in the virtualbasket for the customer (ACT 22). After confirming that a commodity notpermitted to be sold to the customer is absent in the virtual basket forthe customer leaving the store, the processor 31 executes the checkoutprocessing. The processor 31 may execute the checkout processing anytime after confirming that the customer leaving the store is not holdingthe commodity not permitted to be sold. For example, after the customerhas left the store, the processor 31 executes the checkout processingwith a payment method set for the customer in the customer database 18in advance (e.g., a credit card or a direct debit). Consequently, evenin a store where ales-restricted commodities are displayed and sold, itis possible to automate the checkout process without attendance of astore clerk.

If the customer is holding sales-restricted commodities (NO in ACT 20),the processor 31 determines whether a commodity not permitted to be soldto the customer is present among the sales-restricted commodities heldby the customer (ACT 23). For example, the processor 31 determineswhether the customer is permitted to buy each of the sales-restrictedcommodities held by the customer. That is, if a commodity, whose salescondition is not satisfied for the customer, is present among thesales-restricted commodities held by the customer, the processor 31determines that a commodity not permitted to be sold is present.

If a commodity not permitted to be sold to the customer is present (YESin ACT 24), the processor 31 performs control for prohibiting passagethrough the store exit of the customer (ACT 25). For example, theprocessor 31 outputs a control signal for closing the gate 15 b to thestore-leaving control device 15 (i.e., a closing signal). Thestore-leaving control device 15 receives the control signal from theserver 11 via the NW I/F 55. The processor 51 of the store-leavingcontrol device 15 controls the gate 15 b to close according to theclosing signal from the server 11. Consequently, the customer holdingthe commodity not permitted to be sold is prohibited from passingthrough the store exit and cannot leave the store.

If a commodity not permitted to be sold to the customer is present (YESin ACT 24), the processor 31 control the alert device 16 to output analert (ACT 26). The processor 31 informs via the alert device 16 thatthe commodity not permitted to be sold to the customer is present amongcommodities held by the customer (i.e., commodities present in thevirtual basket). For example, the processor 31 controls the alert device16 having a speaker to output alarm sound and/or control the alertdevice 16 having a display to display an image of the commodity notpermitted to be sold to the customer. The processor 31 may inform, viathe alert device 16, guidance that the customer should return thecommodity not permitted to be sold.

After closing the gate 15 b and outputting the alert, the processor 31continues the monitoring processing for the customer. That is, afteroutputting the alert for informing that the commodity not permitted tobe sold is present, the processor 31 returns to ACT 15 and detectsaddition of a commodity, return of a commodity, store leaving action,and the like. If the customer returns the commodity not permitted to besold, the processor 31 executes return processing for the commodity. Ifthe commodity not permitted to be sold is absent in the virtual basketas a result of the return processing, the processor 31 proceeds to ACT21 and permits the customer to leave the store.

If the customer is not holding a commodity not permitted to be sold (YESin ACT 20 and NO in ACT 24), the processor 31 controls the gate 15 b toopen (ACT 21) and executes the checkout processing (ACT 22). Asexplained above, the processor 31 executes the checkout processing afterconfirming that a sales-restricted commodity prohibited from being soldto the customer is absent in commodities carried away from the store bythe customer leaving the store.

As explained above, the server 11 that performs the first operationconfirms that a sales-restricted commodity not permitted to be sold tothe customer is absent in the virtual basket before the customer leavesthe store. If the customer who is about to leave the store holds asales-restricted commodity not permitted to be sold, the server 11controls the gate 15 b at the store exit to close and prohibits thecustomer from leaving the store. The server 11 prohibits the customerholding the sales-restricted commodity not permitted to be sold fromleaving the store and outputs an alert for urging the customer to returnthe sales-restricted commodity not permitted to be sold. If confirmingthat the customer is no longer holding the commodity not permitted to besold, the server 11 controls the gate 15 b to open to let the customerleave the store, and executes the checkout processing.

Consequently, the server 11 and the automated store system can prevent acustomer not satisfying a sales condition from taking out asales-restricted commodity (e.g., an age-limited commodity not permittedto be sold due to the age of the customer) to the outside of the store.As a result, automated checkout without attendance of any store clerkcan be done even in a store where commodities including sales-restrictedcommodities are sold.

A second operation performed by the automated store system is explained.

In the second operation, if a customer touches a commodity (or picks upa commodity) in the store, the automated store system checks whether thecustomer satisfies a sales condition for the touched commodity. In thesecond operation, if the customer does not satisfy the sales conditionfor the touched commodity (i.e., if the customer touches asales-restricted commodity not permitted to be sold), the automatedstore system outputs an alert.

FIGS. 11 and 12 are flowcharts for explaining the second operationperformed by the server 11 in the automated store system.

In the second operation, as in ACTS 11 to 14 explained in the firstoperation example, the processor 31 of the server 11 executes thestore-entry processing on a customer entering the store (ACTS 31 to 34).That is, the processor 31 of the server 11 receives, from theinformation acquiring device 13 located at the store entrance,information concerning the customer acquired from the store visitor (ACT31). The processor 31 of the server 11 determines, based on theinformation concerning the customer acquired by the informationacquiring device 13, whether the customer is a customer registered inthe customer database 18 (ACT 32). If the customer is registered (YES inACT 32), the processor 31 controls the gate 12 b to open (ACT 33) andgenerates a virtual basket for the customer (ACT 34).

After permitting the customer to enter the store, the processor 31performs monitoring processing for monitoring behavior of the customerin the store. In the monitoring processing in the second operation, theprocessor 31 detects that the customer touches a commodity in the store(ACT 35). For example, the processor 31 detects based on one or moreimages or a video taken by the camera 14 that the customer touches acommodity in the store.

If detecting that the customer touches a commodity (YES in ACT 35), theprocessor 31 specifies the commodity touched by the customer. Afterspecifying the commodity touched by the customer, the processor 31determines whether the commodity touched by the customer is asales-restricted commodity (ACT 36). For example, the processor 31specifies the commodity touched by the customer by performing imagerecognition on the images or video taken by the camera 14. The processor31 may specify the commodity by specifying the display location of thecommodity touched by the customer.

If the commodity touched by the customer is not a sales-restrictedcommodity (NO in ACT 36), the processor 31 proceeds to ACT 42.

If the commodity touched by the customer is a sales-restricted commodity(YES in ACT 36), the processor 31 determines whether thesales-restricted commodity touched by the customer is a commodity notpermitted to be sold to the customer (ACT 37). The processor 31determines whether the customer satisfies a sales condition for thesales-restricted commodity touched by the customer. If the customer doesnot satisfy the sales condition for the sales-restricted commoditytouched by the customer, the processor 31 determines that the customertouches a commodity not permitted to be sold to the customer.

If determining that the customer touches a sales-restricted commoditynot permitted to be sold (YES in ACT 38), the processor 31 controls thealert device 16 to output an alert (ACT 39). In the second operation, itis assumed that the alert device 16 outputs the alert to customerspresent in the store. Therefore, in the automated store systemperforming the second operation, a plurality of alert devices may beinstalled at different locations (e.g., a wall and a ceiling) in thestore. In such a configuration, the processor 31 controls one of thealert devices near the commodity touched by the customer to output thealert.

The alert is an alert for informing a warning to the customer. Forexample, the alert may be an alert for outputting alarm sound to thecustomer or may be an alert for displaying guidance indicating that acommodity not permitted to be sold is returned. Consequently, if thecustomer touches a sales-restricted commodity not permitted to be soldin the store, it is possible to provide the customer with a timelyalert.

The processor 31 continues the monitoring processing until the customerleaves the store. For example, even after the processor 31 outputs analert for informing that a commodity not permitted to be sold ispresent, the processor 31 continues the monitoring processing until thecustomer leaves the store. If the processor 31 control the alert device16 to output the alert to the customer who touches the commodity notpermitted to be sold, the processor 31 detects, with the monitoringprocessing, whether the customer moves away from the sales-restrictedcommodity not permitted to be sold.

If the customer does not move away from the sales-restricted commoditynot permitted to be sold (NO in ACT 40), the processor 31 proceeds toACT 42 and continues the monitoring processing while continuing thealert. If the customer moves away from the sales-restricted commoditynot permitted to be sold (YES in ACT 40), the processor 31 controls thealert device 16 to stop the alert (ACT 41) and proceeds to ACT 42.Therefore, if the customer touching the commodity not permitted to besold immediately moves away from the commodity according to the alert,the alert immediately stops. Consequently, in the second operation, itis possible to immediately output an alert and call attention if thecustomer touches the sales-restricted commodity not permitted to besold.

With the monitoring processing, the processor 31 monitors that thecustomer holds a commodity, returns a commodity, and takes store leavingaction. If detecting with the monitoring processing that the customerholds a commodity (YES in ACT 42), the processor 31 specifies thecommodity held by the customer. For example, if detecting from theimages or video taken by the camera 14 that the customer stores acommodity in his basket, bag, shopping cart, or the like, the processor31 determines that the customer holds the commodity. Alternatively, ifdetecting from the images or video that the customer holds a commodityand moves, the processor 31 may determine that the customer holds thecommodity.

After specifying the commodity held by the customer, the processor 31acquires information concerning the commodity held by the customer fromthe commodity database 17. After acquiring the information concerningthe commodity held by the customer, the processor 31 stores theinformation concerning the commodity held by the customer in the virtualbasket (i.e., the storage region 32 a) (ACT 43).

The processor 31 monitors, with the monitoring processing, whether thecustomer returns a commodity once taken by the customer in the store(ACT 44). For example, the processor 31 detects from the images or videotaken by the camera 14 that the customer returns the commodity oncetaken by the customer. If detecting that the customer returns thecommodity (YES in ACT 44), the processor 31 executes commodity returnprocessing involved in the return of the commodity by the customer (ACT45).

As the commodity return processing, the processor 31 specifies thecommodity returned by the customer. For example, the processor 31specifies the commodity returned by the customer by performing imagerecognition on the images or video taken by the camera 14. The processor31 may specify the commodity returned by the customer based on thecustomer's location and the display location of the commodity in thestore. The processor 31 may specify the commodity returned by thecustomer concurrently using a sensor that detects the commodity at apredetermined display location and outputs a signal. After specifyingthe commodity returned by the customer, the processor 31 deletesinformation indicating the commodity returned by the customer from thevirtual basket.

After executing the commodity return processing, the processor 31 checkswhether a sales-restricted commodity not permitted to be sold is absentamong commodities held by the customer (ACT 46). For example, theprocessor 31 checks whether a sales-restricted commodity not permittedto be sold remains in the virtual basket of the customer. If thecustomer does not hold a sales-restricted commodity not permitted to besold (YES in ACT 46), the processor 31 controls the alert device 16 tostop the alert (ACT 47). The processor 31 may execute the processing inACTS 46 and 47 if the alert is generated.

The processor 31 monitors based on, for example, one or more images or avideo taken by the camera 14 whether the customer is about to leave thestore (i.e., perform the store leaving action) (ACT 48). For example,the processor 31 considers that the customer is about to leave the storeif the customer moves to the store exit. The processor 31 may considerthat the customer is about to leave the store if the sensor 15 aprovided at the store exit detects the customer.

If detecting that the customer is about to leave the store (i.e.,perform the store leaving action) (YES in ACT 19), the processor 31checks whether the customer is not holding a sales-restricted commoditynot permitted to be sold (ACT 49). For example, the processor 31determines whether a sales-restricted commodity not permitted to be soldis present in the virtual basket (i.e., the storage region 32 a) for thecustomer. The processor 31 may determine, according to whether an alertis being output to the customer, the customer is holding asales-restricted commodity not permitted to be sold.

If determining that the customer is holding a sales-restricted commodity(NO in ACT 49), the processor 31 controls the gate 15 b installed at thestore exit to close (ACT 50). In this case, the processor 31 controlsthe alert device 16 to continue to output the alert to the customer.Therefore, the alert is output for the customer still holding thesales-restricted commodity not permitted to be sold. Further, thecustomer is prohibited from passing through the store exit.

If the processor 31 controls the gate 15 b to close and prohibits thecustomer from leaving the store, the processor 31 continues themonitoring processing for the customer. That is, the processor 31controls the alert device 16 to continue to output the alert forinforming that a commodity not permitted to be sold is present, and waitfor return of the commodity. If the customer returns allsales-restricted commodities not permitted to be sold, the processor 31executes return processing for the commodities and control the alertdevice 16 to stop the alert.

If the customer is not holding any sales-restricted commodity (YES inACT 49), the processor 31 controls the gate installed at the store exit15 b to open (ACT 51). After permitting the customer to leave the store,the processor 31 determines commodities purchased by the customer andexecutes checkout processing (ACT 52). For example, the processor 31executes the checkout processing for commodities present in the virtualbasket for the customer permitted to leave the store. The checkoutprocessing may be the same as the processing explained in the firstoperation.

As explained above, in the second operation, the server 11 outputs analert if the customer touches a commodity not permitted to be sold inthe store. Further, if the customer holding a sales-restricted commoditynot permitted to be sold is about to leave the store, the server 11closes the gate of the store exit and prohibits the customer fromleaving the store. Consequently, at a point in time when the customertouches the sales-restricted commodity not permitted to be sold, theserver 11 can inform the customer that the commodity is not permitted tobe sold. As a result, even in a store where commodities includingsales-restricted commodities are sold, automated checkout can be donewithout attendance of any store clerk.

The several embodiments are explained above. However, the embodimentsare presented as examples and are not intended to limit the scope of theinvention. These new embodiments can be implemented in other variousforms. Various omissions, substitutions, and changes can be made withoutdeparting from the spirit of the invention. These embodiments andmodifications of the embodiments are included in the scope and the gistof the invention and included in the inventions described in claims andthe scope of equivalents of the inventions.

What is claimed is:
 1. A store management server configured tocommunicate with an alert device installed at a first gate in a store,the server comprising: a network interface; and a processor configuredto: identify a customer entering the store, acquire customer informationabout the identified customer, detect that the customer is holding acommodity in the store, acquire sales restriction information about thecommodity held by the customer, determine whether the customer iseligible to buy the commodity held by the customer based on the acquiredcustomer information and sales restriction information, and control thenetwork interface to transmit, when it is not determined that thecustomer is eligible to buy the commodity, a first command to an alertdevice, wherein the first command causes the alert device to output analert.
 2. The store management server according to claim 1, wherein theprocessor is further configured to control the network interface totransmit, when it is not determined that the customer is eligible to buythe commodity, a second command to a first gate control device, and thesecond command causes the first gate control device to close the firstgate.
 3. The store management server according to claim 2, wherein theprocessor is further configured to: store, in a memory, informationabout the commodity held by the customer, control the network interfaceto transmit, when it is determined that the customer is eligible to buythe commodity, a third command to the first gate control device, thethird command causing the first gate control device to open the firstgate, and after the first gate is opened, perform a checkout processbased on the information stored in the memory.
 4. The store managementserver according to claim 2, wherein the first gate is located at anexit of the store, and the processor is further configured to: detectthe customer approaching the exit of the store, and control the networkinterface to transmit, when the customer approaches the exit, the firstand second commands to the alert device and the first gate controldevice, respectively.
 5. The store management server according to claim4, wherein the processor is further configured to, when failing toacquire the customer information about the detected customer, controlthe network interface to transmit a fourth command to a second gatecontrol device, and the fourth command causes the second gate controldevice to close a second gate in the store.
 6. The store managementserver according to claim 5, wherein the second gate is located at anentrance of the store.
 7. The store management server according to claim1, wherein the first command causes the alert device to output the alerton a display.
 8. The store management server according to claim 1,wherein the first command causes the alert device to output the alertfrom a speaker.
 9. The store management server according to claim 1,wherein the alert device is installed on a wall or a ceiling of thestore, and the processor is further configured to control the networkinterface to transmit, when the customer holds the commodity, the firstcommand to the alert device to output the alert.
 10. A store managementsystem, comprising: an alert device installed at a first gate in a storeand configured to output an alert; and a store management serverconfigured to communicate with the alert device and including a networkinterface and a processor configured to: identify a customer enteringthe store, acquire customer information about the identified customer,detect that the customer is holding a commodity in the store, acquiresales restriction information about the commodity held by the customer,determine whether the customer is eligible to buy the commodity held bythe customer based on the acquired customer information and salesrestriction information, and control the network interface to transmit,when it is not determined that the customer is eligible to buy thecommodity, a first command to an alert device, wherein the first commandcauses the alert device to output an alert.
 11. The store managementsystem according to claim 10, further comprising: a first gate controldevice configured to control the first gate, wherein the processor isfurther configured to control the network interface to transmit, when itis not determined that the customer is eligible to buy the commodity, asecond command to the first gate control device, and the second commandcauses the first gate control device to close the first gate.
 12. Thestore management system according to claim 11, wherein the processor isfurther configured to: store, in a memory, information about thecommodity held by the customer, control the network interface totransmit, when it is determined that the customer is eligible to buy thecommodity, a third command to the first gate control device, the thirdcommand causing the first gate control device to open the first gate,and after the first gate is opened, perform a checkout process based onthe information stored in the memory.
 13. The store management systemaccording to claim 11, wherein the first gate is located at an exit ofthe store, and the processor is further configured to: detect thecustomer approaching the exit of the store, and control the networkinterface to transmit, when the customer approaches the exit, the firstand second commands to the alert device and the first gate controldevice, respectively.
 14. The store management system according to claim13, further comprising: a second gate control device configured tocontrol a second gate in the store, wherein the processor is furtherconfigured to, when failing to acquire the customer information aboutthe detected customer, control the network interface to transmit afourth command to the second gate control device, and the fourth commandcauses the second gate control device to close the second gate.
 15. Thestore management system according to claim 14, wherein the second gateis located at an entrance of the store.
 16. The store management systemaccording to claim 10, wherein the first command causes the alert deviceto output the alert on a display.
 17. The store management systemaccording to claim 10, wherein the first command causes the alert deviceto output the alert from a speaker.
 18. A store management method,comprising: identifying a customer entering a store; acquiring customerinformation about the identified customer; detecting that the customeris holding a commodity in the store; acquiring sales restrictioninformation about the commodity held by the customer; determiningwhether the customer is eligible to buy the commodity held by thecustomer based on the acquired customer information and salesrestriction information; and after determining that the customer is noteligible to buy the commodity, issuing a first command that causes analert device installed at a first gate in the store to output an alert.